
Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 




(n) Publication number : 0 596 624 A2 



EUROPEAN PATENT APPLICATION 



@ Application number : 93308342.0 
(22) Date of filing : 20.10.93 



© int. ci. s : H04L 12/56, H04Q 11/04 



(30) 


Priority: 29.10.92 US 968091 


(72) Inventor : Sriram, Kotikalapudi 
84 Strathmore Gardens 


@ 


Date of publication of application : 
11.05.94 Bulletin 94/19 


Matawan, New Jersey 07747 (US) 
@ Representative : Watts, Christopher Malcolm 


© 


Designated Contracting States : 


Kelway, Dr. et al 




DE FR GBSE 


AT & T (UK) Ltd. 5, Mornington Road 
Woodford Green Essex, IG8 0TU (GB) 




Applicant : AMERICAN TELEPHONE AND 
TELEGRAPH COMPANY 
32 Avenue of the Americas 
New York, NY 10013-2412 (US) 





CM 
< 

CM 
CO 

CO 
O 

in 



@ Bandwidth allocation, transmission scheduling, and congestion avoidance in broadband 
asynchronous transfer mode networks. 



(5?) A wide variety of call traffic is effectively 
integrated in a single broadband communi- 
cations network. Calls having widely differing 
bandwidth requirements and sensitivities to de- 
lay are handled by the network with efficient, 
effective, and fair bandwidth allocation and 
transmission scheduling. This is accomplished 
by classifying each call in accordance with 
certain signal characteristics, such as required 
bandwidth and sensitivity to delay. Each call 
class is directed to a separate queuing circuit 
Some calls in certain classes, such as those 
associated with high-bandwidth constant bit 
rate services, are each directed to their own 
individual queuing circuits. Other calls within a 
class are statistically multiplexed into a single 
queuing circuit for that class. A multiplexing 
circuit operates in accordance with a dynamic 
time slice scheme which involves defining a 
service cycle time period during which the mul- 
tiplexer withdraws a predetermined number of 
information packets from each of a plurality of 
queuing circuits containing information pack- 
ets and places those predetermined numbers of 
-packets onto an output link. The multiplexer 
breaks up the cycle time period into a plurality 
of time slices, each of which determines how 
many information packets are transmitted from 
each queuing circuit during the cycle time 
period. Efficient resource usage and conges- 
tion avoidance are further achieved by using 
one of a number of alternative scheduling 
techniques for delay insensitive traffic. 



FIG. 1 
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Technical Field 

This invention relates to high-speed communica- 
tions networks. More particularly, this invention re- 
lates to bandwidth allocation, transmission schedul- s 
ing, and congestion avoidance on broadband commu- 
nications networks. 



Background of the Invention 
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A significant amount of successful work has been 
done in the area of integrating voice and data signals 
on relatively low speed networks such as DS1 net- 
works operating at 1.536 Mb/sec. and E1 networks 
operating at 2.048 Mb/sec. See, for example, U.S. Pa- 15 
tent 4,914,650 issued to K. Sriram which describes an 
integrated voice and data network having a band- 
width allocation and congestion control scheme in- 
volving separate queues for voice, data, and signal- 
ing. In the network described in the patent, voice 20 
packets are transmitted from the voice queue during 
a predetermined time interval T1 and data packets 
are then transmitted from the data queue for a prede- 
termined time interval T2. Transmission of voice and 
data packets for intervals T1 and T2 is then repeated 25 
until the voice and data queues are depleted. If one 
or more signaling packets enter the signaling queue, 
transmission of voice and data packets is suspended 
and the signalling packets are transmitted until the 
signalling queue is empty. 30 

Summary of the Invention 

Broadband high-speed packet networks, such as 
those based on the broadband integrated services 35 
digital network (B-ISDN) standard and the asyn- 
chronous transfer mode (ATM) standard, are able to 
handle many more diverse kinds of traffic than the 
low-speed networks of the past. These diverse kinds 
of traffic include voice, interactive data, images, bulk 40 
data, and several different kinds of video. These dif- 
ferent types of traffic vary widely in their bandwidth 
requirements and tolerance to message delay and 
loss. It would be economically unattractive to imple- 
ment an individually designed network specifically 45 
tailored for each of these types of traffic. Thus, there 
is a critical need to efficiently integrate these diverse 
traffic types on a single network for high-speed net- 
works to become a commercial reality. This invention 
r meets that need by providing a cyclic service disci- 50 
pline which achieves efficient allocation of band- 
width, congestion avoidance, and fairness for the 
many different types of traffic handled in high- speed 
communications networks. 
a In one specific example of the invention, commu- 55 
j nications traffic in each node of a high-speed network 
is segregated in accordance with certain signal char- 
acteristics and stored in separate queuing circuits for 



delivery to a single output line under the control of a ] 
multiplexing circuit This segregation may be based ' 
upon whether the communications traffic is high or 
low bandwidth, isochronous or non-isochronous, and 
delay sensitive or delay insensitive. A multiplexing cir- . 
cuit in each node defines a service cycle time period 
Dc during which each of n queuing circuits is permit- 
ted to deliver cells to an output line connected to the 
node. A certain amount of bandwidth is guaranteed to 
the traffic flowing into each of the queuing circuits by 
allocating certain slices of time T1, T2, ... Tn within 
the service cycle time period Dc to each of the n j 
queuing circuits. During its allocated time slice, a re- 
spective queuing circuit is allowed by the multiplexing 
circuit to empty a predetermined number of cells stor- 
ed in the queuing circuit onto an output line of the net- / 
work node. 

For some types of traffic, such as constant bit 
rate services and non-real-time bulk information 
transport services, a separate queuing circuit is pro- 
vided for each call. A call involving constant bit rate 
services is admitted if there is sufficient unused 
bandwidth on the output link to guarantee the neces- 
sary bandwidth for the duration of the call. A call in- 
volving non-real-time bulk information transport ser- 
vices is admitted when there is sufficient unused stor- 
age and transmission capacity in the network to ac- 
commodate the call. For other types of traffic, such 
as variable bit rate services, multiple calls are statist- 
ically multiplexed into a single queuing circuit. A call 
involving a statistically multiplexed service is admit- 
ted when permitted to do so in light of information con- 
tained in traffic tables stored in the node. The traffic 
tables provide information relating the number of calls 
in a class to the amount of bandwidth required forthat 
number of calls to be effectively statistically multi- 
plexed. 

This is just one example of this invention. Other 
examples will be readily apparent from the following 
detailed description read in conjunction with the ap- 
pended claims which define the full scope of the in- 
vention. 

Brief Description of the Drawings 

FIG. 1 is a schematic diagram of an illustrative 
asynchronous transfer mode communications net- 
work in accordance with this invention. 

FIG. 2 illustrates the structure of an asynchron- 
ous transfer mode (ATM) cell which is used to trans- 
port information through the network of FIG. 1. 

FIG. 3 is a detailed diagram of one of the network 
nodes shown in FIG. 1. 

FIG. 4 is a graphical representation of the approx- 
imate required bandwidth and tolerable delay for the 
traff ic classifications handled by the ATM network of 
FIG. 1. 

FIG. 5 is a schematic diagram of a dynamic time 
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slice service apparatus used to control the allocation 
of bandwidth to calls and the multiplexing of ATM cells 
onto one of the output links associated with one of the 
nodes shown in FIG. 1 . 

FIG. 6 is a block diagram illustrating in more detail 
the dynamic time slice server shown in FIG. 5. 

FIG. 7 is a flow chart illustrating in more detail the 
cell selection controller of FIG. 6. 

FIGs. 8 and 9 are flow charts illustrating in more 
detail the call controller and bandwidth allocator 
shown in FIG. 6. 

FIG. 10 is a block diagram illustrating the dynam- 
ic time slice allocator shown in FIG. 6. 

Detailed Description 

FIG. 1 illustrates a representative portion of an 
asynchronous mode transfer mode (ATM) communi- 
cations network in accordance with this invention. 
The network comprises a plurality of interconnected 
nodes 10, 12, 14, 16, 18, and 20. Each node receives 
input signals on a plurality of input links and routes 
those input signals to one of a plurality of output links. 
For example, a typical node 10 receives input signals 
on input links 22 and 24 from another node in the net- 
work not shown in FIG. 1 and selectively directs those 
signals on output links 26, 28, and 30 to nodes 12, 14, 
and 16, respectively. The output links 26, 28, and 30 
are thus input links to nodes 12, 14, and 16, respec- 
tively. Although not shown in FIG. 1, there may also 
be links directing signals from one or more of nodes 

12, 14, and 16 to the node 10. The number of nodes 
in FIG. 1 and the way they are connected are merely 
illustrative of an ATM network in accordance with this 
invention. There may be any number of nodes in the 
network and they may be connected together in any 
suitable fashion so that each node has one or more 
ATM inputs and one or more ATM outputs. For exam- 
ple, the links between the nodes in the network may 
be optical fibers which transmit at rates of 150 
Mbit/sec. or higher. 

Information is transmitted through the network 
by means of special kinds of digital information pack- 
ets known as ATM cells. ATM cells may be configured 
as shown in FIG. 2. Such an ATM cell may comprise 
two main parts, a header 11 and an information field 

13. The header 11 may comprise 5 eight-bit digital 
words (called octets) used by the network to properly 
route the ATM cell through the network to its destin- 
ation. The information field 13 may contain 48 eight- 
bit digital words (octets) representing the information 
being conveyed through the network, for example, 
voice samples, video samples or data. The header 
may contain several fields serving different purposes 
in assisting the routing of the cell through the net- 
work. It may contain generic flow control, virtual path, 
and virtual channel fields. It may also contain a loss 
priority field and a header check sequence. The head- 



er may also contain a field, which may be 3 bits in 
size, identifying the call type or payload of the ATM 
cell. An example of how an ATM cell may be config- 
ured is given in ATM standards of the CCITT. 

5 FIG. 3 illustrates the details of one of the network 

nodes in FIG. 1, for example, network node 1 0. Node 
1 0 may comprise a plurality of input buffers, for exam- 
ple, input buffers 21 and 23. Each of the buffers may 
receive ATM cells from a respective input link 22 and 

10 24 and may direct those ATM cells to an ATM switch- 
ing fabric 25 which selectively switches ATM cells re- 
ceived from the input buffers 21 and 23 to multiplex- 
ers 27, 29, and 31 associated with each butput link 26, 
28, and 30 of the node 10. 

15 As described in more detail below, call traffic 

through each of the nodes is classified in accordance 
with certain signal characteristics. Each of the output 
links from the nodes is provided with a queuing mech- 
anism which receives ATM cells for delivery into a 

20 channel on the output link. There is at least one queue 
in the queuing mechanism for each traffic classifica- 
tion. A dynamic time slice server described in more 
detail below is associated with each output link. The 
server multiplexes the contents of the queuing mech- 

25 anism onto its respective output link so that band- 
width is effectively and fairly allocated to a wide vari- 
ety of traffic normally found ina high speed ATM net- 
work. 

Traffic types found in high speed ATM networks 
30 are classified as follows in this example of the inven- 
tion. The approximate bandwidth required for exam- 
ples of each of these traffic types, and the approxi- 
mate tolerable delay for those examples, is graphical- 
ly represented in FIG. 4. 

35 

Type 1A: Delay-Sensitive Isochronous High 
Bandwidth Services 

This type of traffic is a real-time high bandwidth 
40 service (RT-HBS). It is isochronous because it re- 
quires a fixed high bandwidth for the duration of a call. 
It requires real time service and, therefore, guaran- 
teeing bandwidth at the time of call setup is neces- 
sary. Examples of this kind of traffic are constant bit 
45 rate (CBR) conference video and other real time high 
bandwidth CBR services such as the IBM channel-to- 
channel interconnect. Fixed rate video may be deliv- 
ered at rates of 1 0, 20, 45, or 90 Mb/sec, for example. 
Rates greater than 100 Mb/sec. are possible. The de- 
50 lay tolerance of this traffic type is typically on the or- 
der of no more than several tens of milliseconds. 

Type 1 B: Delay-Sensitive Non- Isochronous 
High Bandwidth Services 
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This traffic is also an RT-HBS type of service, but 
it is non-isochronous in that each call alternates be- 
tween active and inactive periods. These services 
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generate a high bandwidth data stream during the ac- 
tive periods. Examples of this type of traffic include 
variable bit rate (VBR) video and the traffic flowing on 
interconnections between local area networks (LAN- 
to-LAN interconnects). This type of traffic may be fur- 5 
ther divided into subclasses. For example, VBR video 
and LAN-to-LAN calls may be separately grouped for 
admission control, bandwidth allocation, and buffer 
management This type of traffic may tolerate delays 
on the order of about 100 msec. The bandwidth re- w 
quirementfor a call of this type may range from about 
a fraction of 1 Mb/s to about several Mb/s. 



Tv P e 2: Delay-Insensitive High Bandwidth 
Services " 
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This traffic comprises non-real-time bulk infor- 
mation transport services. The sender may specify 
the extent of delay which is tolerable between the 
sending and receipt of the information. The sender 20 
may specify the tolerable delay in minutes or hours or 
may specify overnight delivery, for example. There 
are several alternatives described in detail below for 
appropriately serving this type of traffic. Essentially 
the network transports this type of traffic during slack 25 
periods. Hence, there must be suitable ways of stor- 
ing the bulk information in the network, identifying 
the slack periods in network activity, and scheduling 
the transmission of the information through the net- 
work. Examples of this traffic type include delivery 30 
services involving data, documents, images, and vid- 
eo. 

Type 3: Low Bandwidth Statistically Multiplexed 
Services (SMS) 35 

Calls of this type are delay sensitive with end-to- 
end delay requirements ranging from less than a mil- 
lisecond to a few tens of milliseconds. The bandwidth 
range for such calls may be in the range of about 1 40 
kb/sec. to more than about 100 kb/sec. Examples of 
such traffic include packetized voice, interactive data, 
inquiry response messages, images, e-mail, and 
other voice band data. 

The traffic classification described here may be 45 
accomplished at a virtual circuit level. The header in 
each ATM cell may provide virtual channel identifier 
(VCI) information in a virtual channel field. Based on 
information obtained from the sending terminal at call 
setup time, the call type may be determined. Each 50 
ATM switch involved in the call routing can maintain 
a table which maps VCIs to call types for all the calls 
flowing through that switch. The detailed traffic clas- 
sification scheme described above is used to imple- 
ment appropriate resource sharing methods descri- 55 
bed below. 

FIG. 5 shows an illustrative circuit which multi- 
plexes a wide variety of communications traffic in an 



ATM network onto an output link connecting two 
nodes of the network. Specifically, FIG. 5 illustrates 
a multiplexing circuit 29 in node 10 which combines 
communications traffic from a number of sources 
onto the output link 28 shown generally in FIGs. 1 and 
3. As shown in FIG. 5, the output link 28 has an illus- 
trative bandwidth of 150 Mb/sec. As described above, 
there may be similar circuits for each of the output 
links in the network of FIG. 1. 

As described above, the communications traffic 
is classified in accordance with certain signal charac- 
teristics by the node 10. The traffic which is to be di- 
rected on the output link 28 is selectively directed to 
a number of different queuing circuits based upon the 
results of the classification. Specifically, the previ- 
ously described Type 3 traffic is directed to queues 32 
and 34 in FIG. 5. All of the voice traffic in the node 10 
to be sent on the output link 28, which may comprise 
one or more voice calls, is statistically multiplexed into 
a voice queue 32. Similarly, all of the low-speed data 
traffic is statistically multiplexed into a low-speed data 
queue 34. Traffic relating to real time high bandwidth 
services, the Types 1A and 1B services described 
above, is directed to queuing circuits 36, 38, 40, and 
42. Each call involving a Type 1 A service is directed 
to its own queuing circuit in FIG. 5. Specifically, FIG. 
5 shows two constant bit rate video calls, each of 
which is directed into separate queuing circuits 36 and 
38, respectively. Type 1B calls are divided into two 
subclassifications in FIG. 5, namely, those calls in- 
volving LAN-to-LAN communications which are stat- 
istically multiplexed into the queuing circuit 40 and 
those calls involving variable bit rate video which are 
statistically multiplexed into the queuing circuit 42. 
Calls involving delay insensitive high bandwidth ser- 
vices, the previously described Type 3 services, are 
each directed to a separate queuing circuit. The circuit 
of FIG. 5 is handling two calls of this type, a bulk data 
transfer in a queuing circuit 44 and a bulk video deliv- 
ery call in a queuing circuit 46. 

A dynamic time slice (DTS) server 48 defines a 
predetermined cycle time Dc during which it visits 
each of the queuing circuits in sequence and with- 
draws a predetermined number of ATM cells from the 
queuing circuit and transfers that predetermined 
number of cells onto the output link 28. The predeter- 
mined cycle time period Dc is selected so that it is no 
longer than the maximum amount of time delay which 
is tolerable for the most delay sensitive traffic han- 
dled by the node 10. Preferably, this cycle time period 
may be in the range of about 1 to 2 msec. In the ex- 
ample of the invention shown in FIG. 5, the cycle time 
period is selected to be no longer than about 1.2 
msec. Since the output link 28 has a bandwidth of 150 
mb/sec, this 1.2 msec, time period amounts to the 
withdrawal of a total of 450 ATM cells from the queu- 
ing circuits in FIG. 5 and the transmission of those 
450 cells onto the output link 28. 
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The traffic contained in the queuing circuits in 
FIG. 5 is guaranteed a minimum percentage of the to- 
tal bandwidth available on the output link 28. This is 
accomplished by the server 48 withdrawing a certain 
predetermined number of cells from each of the queu- 
ing circuits during a cycle time period Dc. In the ex- 
ample shown in FIG. 5, the server 48 withdraws thirty 
ceils from the voice queue 32 on line 33 and transmits 
those thirty voice cells onto the output link 28. The 
bandwidth on line 33 and the bandwidth on output link 
28 devoted to voice traffic thus is 10 Mb/sec. After 
those voice cells have been transmitted, the server 
48 then withdraws thirty cells from the low speed 
data queue 34 on a line 35. The bandwidth of line 35 
and the bandwidth on output link 28 devoted to low 
speed-data thus is 10 Mb/sec. like that for voice traf- 
fic. Similarly, during the cycle time period the server 
48 withdraws sixty cells from CBR video queue 36 on 
line 37, thirty cells from CBR video queue 38 on line 
39, sixty cells from LAN-to- LAN queue 40 on line 41 , 
and ninety cells from VBR video queue 42 on line 43. 
Thus, the one CBR video call associated with queue 
36 is given 20 Mbit/sec. of the total 150 mbit/sec. 
available bandwidth on output link 28. The other CBR 
video call associated with queue 38 is given 10 
Mbit/sec. of the total 150 Mbit/sec. available on the 
link 28. (These CBR video bit rates are only illustra- 
tive; the actual rates would depend on the coding a 
compression algorithms used in practice.) Statistical- 
ly multiplexed LAN-to-LAN calls get 20 Mbit/sec. of 
the 150 Mbit/sec. total bandwidth available on I ink 28. 
The remainder of the available bandwidth on line 28 
is devoted to the two bulk delivery calls illustrated in 
FIG. 5. Specifically, the server 48 withdraws fifteen 
cells from bulk data queue 44 on line 45 during the cy- 
cle time period and server 48 withdraws 135 cells 
from video delivery queue 46 on line 47 during that 
same time period and delivers those cells onto output 
link 28. Bulk data thus is given 5 Mbit/sec. on the link 
28 and video delivery data is given 45 Mbit/sec. on 
the link 28. 

The server 48 in effect defines a cycle time per- 
iod Dc during which it will retrieve cells from all of the 
queues having cells to send. The server 48 divides 
the cycle time period into time slices T1, T2, ... Tn, as- 
signs a time slice to each of the queues, and permits 
each queue to empty cells onto the output link 28 dur- 
ing its respective time slice. The server 48 accom- 
plishes this by visiting each queue in sequence, re- 
moving a predetermined number of cells from each 
queue, and then moving on to remove a predeter- 
mined number of cells from the next queue in se- 
quence. All queues are visited within the next cycle 
time period Dc defined by the server 48. At the com- 
pletion of the cycle time period, the server 48 repeats 
the cycle of visiting each queue and removing respec- 
tive predetermined numbers of cells from each queue 
within the cycle time period. If any one of the queues 



contains no cells, then the server completely passes 
over the empty queue and immediately moves on to 
the next queue in sequence to remove its allotted 
number of cells. If any of the queues contains a num- 

5 ber of cells which is less than the predetermined num- 
ber of cells the server 48 is scheduled to remove dur- 
ing a cycle time period, then the server 48 removes 
cells from that queue until it is empty and immediately 
moves on to the next queue to remove its allotted 

10 number of cells. Thus, the server 48 may complete a 
cycle of removing cells from all queues in an amount 
of time which is less than the cycle time period. 

As described above, the dynamic time slice ser- 
ver 48 shown in FIG. 5 thus services all the queues 

is by cyclically visiting each queue and allocating a slice 
of time to it so that a predetermined number of cells 
may be removed from the queue and placed on the 
output link 28. The time slice allocated to a queue is 
proportional to the amount of bandwidth on the out- 

20 put link 28 required by that queue. In general, the 
number of queues "n" changes as the number of traf- 
fic classes handled by the output link 28 in node 10 
changes. Also, "n" varies with the number of Type 1 A 
and Type 2 calls directed to the output link 28 because 

25 dedicated queues are required for each of these calls. 
As "n" varies, the time slice allocations T1, T2 ... Tn 
for each of the queues change to reflect the propor- 
tionate bandwidth requirements for all traffic classes 
or HBS calls in service. The units of the time slices are 

30 expressed in terms of numbers of ATM cells as descri- 
bed above. 

Although not illustrated in FIG. 5, there may be 
one queue at each link dedicated solely to signaling 
traffic (including call set-up, call tear-down, network 

35 congestion controls, etc.). The signalling cells may be 
identified either by their dedicated VCI's (for common 
channel signalling) or by their payload type (for chan- 
nel associated signalling). This queue would have a 
generous allocation of buffers to ensure no cell loss 

40 (for example, a probability of signalling cell loss of 
less than 10-9). Its time slice parameter TO should be 
chosen so that signalling cells would have a negligible 
probability of waiting more than one cycle time period 
before delivery onto the output link 28. 

45 A variety of servicing schemes may be applied to 

call admittance and setup depending on the charac- 
teristics and requirements of the various traffic class- 
es considered above. 

50 Servicing Scheme For Isochronous HBS Traffic 
(Type 1A): 

The user first makes a call setup request for allo- 
cation of a virtually reserved peak bandwidth. The 
55 network sends a bandwidth allocation request to all 
nodes enroute to the destination. The user is guaran- 
teed the requested peak bandwidth for the duration 
of the call. Any efficient routing scheme may be used 
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to find an appropriate path through the network along 
which the requested bandwidth is reserved. 

Servicing S cheme For Non-Isochrono us HBS 
Traffic (Type 1B): 

Calls of this type are divided into several sub- 
classes, for example. LAN-to- LAN and VBR video 
subclasses. Calls within each of these subclasses 
are statistically multiplexed into a single queue. Each 10 
call subclass is given a guaranteed minimum band- 
width by virtue of the server allocating a finite time 
slice to each of the queues. Bandwidth versus capaci- 
ty tables (i.e.. traffic tables) are maintained for each 
subclass. Atraff ic table indicates the amount of band- ,s 
w.dth needed to multiplex a given number of calls for 
that call subclass. The table may be determined by 
taking into consideration the burstiness. coding type 
and performance requirements for the call subclass 
under consideration. If spare bandwidth is available 20 
on the output link 28, a new call of this type is admit- 
ted and the bandwidth (i.e., time slice allocation Ti) for 
th.s call subclass is increased as specified in the ca- 
pacity versus bandwidth table. When a call is com- 
pleted, the bandwidth is relinquished by lowering the 25 
time slice allocation Ti for its subclass. Placing each 
of the subclasses within this type of call traffic in a 
separate queue facilitates the appropriate service of 
each subclass in accordance with its individual per- 
formance requirements. Any unused bandwidth, due 30 
to statistical fluctuations in the activity of the calls in 
progress, is momentarily made available to other traf- 
fic in the system. As in the case of the Type 1 A calls 
described above, any efficient routing scheme may 
be used to find an appropriate path through the net- 35 
work for each call. The capacity versus bandwidth ta- 
bles can be refined or updated as traffic characteris- 
tics become better known or technology improves 
For example, new and more efficient video compres- 
sion methods may dictate a change to the traffic ta- 40 
bles. 

There are three illustrative schemes for servicing 
the Type 2 delay insensitive HBS traffic. Servicing 
schemes A and B differ depending on whether infor- 
mation storage is located in a network node or in cus- 45 
tomer premises equipment. Schemes A and B are 
based on the notion of deferred delivery with band- 
width reservation. Scheme C transmits Type 2 ATM 
cells with low priority and no bandwidth guarantee In 
scheme C. Type 2 ATM cells use any cell slots that are 50 
unused by all other classes during the service cycles 
of the server 48. 



time. Th.s Type 2 service node accepts bulk informa- 
tion from the user and stores it in bulk memory The 
user notifies the service node of the intended destin- 
ation for the bulk information and then disconnects 
from the service node. A second stage of call set up 
is done by the network during low traffic periods The 
service node negotiates with other nodes enroute to 
the designated destination for an appropriate band- 
width guarantee so that the transmission of the bulk 
information may be completed within a user specified 
deadhne. Next, the bulk information is transported 
through the network to its destination. A service node 
at the receiving end receives and stores the bulk data 
and notifies the intended recipient. The call is com- 
pleted to the recipient, the bulk information is deliv- 
ered to the recipient, and the sender is given a ser- 
vice completion message. 

Servicing Scheme B For Type 2 Traffic 

The sender first specifies the size of the transac- 
tion, a delay tolerance, and the bandwidth required 
The network then registers a request for call set up 
The bulk information awaits transmission at the sen- 
der's terminal rather than in a service node. The call 
is set up during a slack period in the network but with- 
in the deadline specified by the sender. The bulk in- 
formation then is transported through the network to 
the recipient with an appropriate bandwidth guaran- 
tee to assure delivery within the sender's specified 
deadline. 

Servicing Scheme C For Type 2 Traffic 

In this scheme, all delay insensitive bulk traffic 
calls are serviced through a low priority queue estab- 
lished at each link. This queue has a low priority in the 
sense that it has no bandwidth guarantee. It uses any 
spare bandwidth (idle cell slots) in each cycle of the 
server 48. In order to assure that there is no cell loss 
due to buffer overflow, a backward congestion notifi- 
cation scheme is used. In other words, a STOP/SEND 
signal may be sent to appropriate nodes by a node 
whose buffer is about to overflow. The low priority 
traffic in the queue is transmitted when spare band- 
width is available and the link has a SEND status. 

Servicing Sc heme For Low- Or Medium - 
Bandwidth SMS Traffic fTvpe 3 1- 



Servicing Scheme A For Type 2 Traffic 

The user first sets up a connection with the near- 
est node in the network which services Type 2 call 
traffic. No end-to-end connection is set up at this 



55 



These calls are handled in a mannersimilarto the 
manner in which Type 1 B calls are handled as descri- 
bed above. Different call set up procedures (accep- 
tance and routing) may be used for these kinds of 
calls. Type 3 calls may be divided into several differ- 
ent subclasses, for example, voice, low-speed data 
and interactive images. Each of these subclasses will 
have its own queue. 
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FIG. 6 shows the details of the circuitry in the dy- 
namic time slice server 48. The server 48 contains a 
cell selection controller 50 which selectively connects 
each of a plurality of queues 1, 2, ... n to output link 
28 to cause transmission of a predetermined number s 
of ATM cells from each of those queues in a predeter- 
mined cycle time period Dc. The cell selection control- 
ler is connected to a time slice allocator 52 which de- 
termines and controls how many ATM cells are to be 
withdrawn from each of the queues during the prede- 10 
termined cycle time period. A call controller and band- 
width allocator 54 makes call admittance and denial 
decisions and controls the time slice allocations made 
by the time slice allocator 52 as a function of call traf- 
fic level. This control of time slice allocations is made 75 
by the call controller and bandwidth allocator 54 in 
light of information obtained from control and status 
registers 56 about the amount of link bandwidth which 
is currently in use. The call controller and bandwidth 
allocator 54 also admits or denies additional calls 20 
based on the availability of bandwidth. 

The call controller and bandwidth allocator 54 is 
responsive to information contained in call traffic ta- 
bles 58 relating to the bandwidth needed to statistical- 
ly multiplex successfully a plurality of call traffic levels 25 
for each call classification. It is also responsive to in- 
formation contained in the registers 56 relating to the 
amount of link bandwidth currently in use. The regis- 
ters 56 also contain information about which sched- 
uling scheme A, B, or C is to be used to handle low 30 
priority Type 2 traffic. The choice of which scheme to 
use may be communicated to the registers 56 by way 
of a control information line 60. The information con- 
tained in the traffic tables 58 may be updated by 
means of an update line 62. 35 

FIG. 7 is a flow chart illustrating the nature of the 
cell selection controller 50 in FIG. 6. The operation of 
the controller 50 begins in a block 64 in which an index 
is set to one. In block 66, a check is made to see if the 
nth queue is empty. If it is not, block 68 causes a pre- 40 
determined number mi of cells to be extracted from 
the ith queue and transmitted on the output link 28. 
(mi = Ti/g where Ti is the time slice allocated to queue 
i and g is the cell transmission time.) If there are less 
than mi cells in the ith queue, then cells are extracted 45 
and transmitted until the ith queue is empty. When mi 
cells have been transmitted or the ith queue has been 
emptied, the index i is incremented by one in block 68, 
if i is less than or equal to n- 1, where n is the number 
of queues visited by the server 48 during the current 50 
cycle time period. If i is equal to n, then the index i is 
set to one in block 70. If the ith queue is empty, as de- 
termined in block 66, then the operation of block 70 
is made directly from block 66 bypassing block 68. 

After the operation of block 70, the cell selection 55 
controller 50 makes a determination in block 72 to see 
if the ith queue contains delay-insensitive traffic and 
scheme C described above is in use for that kind of 



traff ic. If the answer is no, the operation of the con- 
troller 50 returns to the input of block 66, the opera- 
tion of which is repeated along with that of successive 
blocks described above. If the answer is yes in block 
72, then in block 74 any unused cells as defined by 
the length of the server's cycle time period Dc is aU 
located to this delay insensitive low priority queue. In 
other words, these low priority cells are withdrawn 
from the queue and transmitted on the output link 28 
until the total number of cells withdrawn from the plur- 
ality of queues currently being served by the DTS 
server 48 equals the total number of cells to be with- 
drawn from the queues during the cycle time period. 
This number of cells is indicated by a variable Mc in 
FIG. 7 and is equal to the previously described 450 
cells for the circuit shown in FIG. 5. When the opera- 
tion of block 74 has been completed, the operation of 
the cell selection controller 50 returns to block 64. At 
this point, the operation of block 64 and the operation 
in successive blocks is repeated as described above. 

FIGs. 8 and 9 are a flow chart representing the 
details of the call controller and bandwidth allocator 
54 shown in FIG. 6. FIG. 8 is a flow chart showing the 
operation of the call controller and bandwidth alloca- 
tor 54 in response to the arrival of a call to be trans- 
mitted on the output link 28. When a type i call arrives, 
block 76 determines the bandwidth needed to ac- 
commodate the call from the traffic tables 58. The cir- 
cuit then makes a determination to see if the required 
bandwidth is available on link 28 in block 78. The cir- 
cuit of FIG. 8 obtains this information from the control 
and status registers 56 in FIG. 6. If the required band- 
width is not available on link 28, the call is denied in 
block 80 and the originating switch may try alternative 
routes to complete the call. If the required bandwidth 
is available on link 28, then the call is admitted in 
block 82 and the time slice allocations are updated 
when the call is set up. The registers 56 are updated 
in block 84 in light of the admittance of this call by the 
call controller and bandwidth allocator 54. 

FIG. 9 is a flow chart representing the behavior 
of the call controller and bandwidth allocator 54 in re- 
sponse to the departure of a call. The circuit first de- 
termines how much bandwidth should be released by 
the departure of the call in block B6. This determina- 
tion is made in light of the information stored in the 
traffic tables 58. The circuit of FIG. 9 then updates the 
time slice allocations in block 88 and updates the reg- 
isters 56 in block 90 regarding the spare bandwidth 
now available on the link 28 in light of the release of 
bandwidth caused by the departure of the subject 
call. 

FIG. 10 shows the structure of the time slice al- 
locator 52 in FIG. 6. A circuit 92 produces a signal re- 
lating to the preselected value Mc which represents 
the total number of cells withdrawn from the queuing 
circuits shown in FIGs 5 and 6 during a desired cycle 
time period, defined by the server 48. As described 
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above, this cycle length may be about 1 msec, to 
about 2 msec. In the example of the invention descri- 
bed in FIG. 5, the value Mc is 450 ATM cells for the 
described link bandwidth of 150 Mbit/sec. Signals B1 , 
B2, ... Bk. representing the required bandwidths for 5 
respective delay sensitive queues, are input to a com- 
putation circuit 94 which determines the number of 
cells mi which the server 48 is to withdraw from the 
ith queue during the previously described service cy- 
cle time period Dc which is defined by the selected 10 
magnitude Mc. A circuit 96 receives a signal as an in- 
put representing which servicing scheme A. B, or C is 
to be used for the delay insensitive queues. If scheme 
A or scheme B has been selected, then the circuit 96 

produces signals Bk+1 Bn, which are determined 15 

in light of negotiated bandwidth allocations. If scheme 
C has been selected, then the delay insensitive calls 
may be merged into one common queue and they use 
the spare bandwidth, namely, the unused cells in 
each service cycle. The outputs of the circuit 96, 20 

Bk+1 Bn - represent the bandwidth requirements 

for the delay insensitive queues which are used by 
the circuit 94 to compute the number of cells which 
are to be withdrawn from the delay insensitive queues 
for transmission on the output link 28. 25 

Summary 



35 



This example of the invention provides a way to 
conveniently handle and integrate a wide variety of 
communications traffic handled by a broadband net- 
work. Bandwidth is effectively and fairly allocated 
and congestion is avoided. The dynamic time slice 
server guarantees a desired bandwidth to calls re- 
quiring a fixed wide bandwidth for the duration of the 
call which facilitates setting up circuit-like constant bit 
rate connections in an asynchronous transfer mode 
network. Statistical multiplexing of calls is done when 
applicable. Call admittance is based upon capacity 
versus required bandwidth tables for statistically mul- 40 
tiplexed calls. We provide an efficient way of combin- 
ing fixed bandwidth constant bit rate services with 
statistically multiplexed services. Each call class is 
placed in a separate queue, acting as a virtual band- 
width pipe, which allows each call class to be served 45 
according to its unique performance requirements 
Any bandwidth unused by a call class or a high band- 
width service call, is momentarily made available to 
other traffic present in the multiplexer. Delay insensi- 
tive high bandwidth bulk traffic (e.g. bulk data and vid- 50 
eo delivery) is stored in customer premises equip- 
ment or in a service node. It may be transmitted via a 
secondary call set up during slack periods in the net- 
work. Alternatively, the delay insensitive high band- 
width traffic may be served through a low priority 55 
queue established at each link and by allowing the 
low priority calls to fill the unused portion of the dy- 
namic time-slice service cycles. 



30 



Claims 

1 . A communications apparatus, comprising: 

a first queuing means for receiving low- 
bandwidth calls; 

a second queuing means for receiving 
high-bandwidth delay sensitive calls; 

a third queuing means for receiving high 
bandwidth delay insensitive calls; and 

a multiplexing means for sequentially and 
cyclically drawing a predetermined number of in- 
formation packets during successive service cy- 
cle time periods from each of the first, second 
and third queuing means and combining those 
packets on a single output line. 

2. The apparatus of claim 1 , in which the first queu- 
ing means comprises: 

a first queue for receiving statistically mul- 
tiplexed voice calls; and 

a second queue for receiving statistically 
multiplexed low bandwidth data calls. 

3, The apparatus of claim 1, in which the second 
queuing means comprises: 

a first queue for receiving variable bit rate 
statistically multiplexed video calls; and 

a second queue for receiving statistically 
multiplexed LAN-tc-LAN calls. 

4- The apparatus of claim 1, in which the second 
queuing means comprises: 

one or more queues each for receiving a 
call requiring a guaranteed peak bandwidth for a 
predetermined part or all of the call. 

5. The apparatus of claim 4, in which the one or 
more queues each receive a constant bit rate call. 

6. The apparatus of claim 5, in which the one or 
more queues each receive a constant bit rate vid- 
eo call. 

7. The apparatus of claim 1 . further comprising: 

means responsive to unused bandwidth 
on the single output line for selectively admitting 
additional calls into selected ones of the queuing 
means. 

8. The apparatus of claim 7, further comprising: 

a call traffic table containing data relating 
to levels of call traffic as a function of required 
bandwidth, the admitting means being respon- 
sive to the data in the call traffic table. 

9. The apparatus of claim 1 , in which the third queu- 
ing means comprises: 

one or more queues each for receiving a 



BNSDOCID: <EP 0596624A2 I > 



15 



EP 0 596 624 A2 



16 



call relating to a bulk information transfer. 

10. A broadband communications network, compris- 
ing: 

a plurality of network nodes, each having s 
at least one input and one output; 

a plurality of links connecting selected 
ones of the outputs with selected ones of the in- 
puts; 

a queuing means associated with each of 10 
the links, each of the queuing means comprising: 

a first queuing circuit for receiving 
statistically multiplexed low bandwidth calls; 

a second queuing circuit for receiv- 
ing a delay sensitive and isochronous high band- 15 
width call: 

a third queuing circuit for receiving 
statistically multiptexed delay sensitive and non- 
isochronous rngi bandwidth calls; and 

a fourth queuing circuit for receiv- 20 
ing a oeu< insensitive high bandwidth call; and 

a r«j!:i;Jfiing means associated with 
each cufj>" ) trw-m* lur defining a predeter- 
mined 1 u^ip tmr i"*-»«jU during which the first, 
second, find. <toi! iv«jriri queuing circuits are 25 
each pcrtrwtir-d tu finely <i respective predeter- 
mined nunt«i of pjv^rts onto its respective link 
during respecti«e p*e Jeter mined slices of time 
within the pfedeter mineO cycle time period. 

30 

11. The network of dam 10. further comprising: 

means responsrve to unused bandwidth 
on one of the links for selectively admitting addi- 
tional calls into selected ones of the queuing cir- 
cuits. 35 

12. The network of claim 11. further comprising: 

call traffic tables containing data relating 
to levels of call traffic as a function of required 
bandwidth, the admitting means being respon- 40 
sive to the data in the call traffic tables. 

13. The network of claim 10, further comprising: 

a variable scheduling means for providing 
a plurality of selectable scheduling schemes for 45 
completing calls related to high bandwidth delay 
insensitive services. 

14. The network of claim 10, in which at least one of 

the network nodes comprises: 50 

a service node having a means for storing 
in memory bulk information relating to at least 
one delay insensitive high bandwidth call, a 
means for delivering the bulk information to a re- 
cipient during a low traffic period in the network, 55 
and a means for providing a predetermined band- 
width guarantee for the bulk information delivery 
along a path between the memory and the reci- 



pient 

15. The network of claim 10, in which at least one of 
the network nodes comprises: 

means for receiving information from a 
sender relating to a transaction size, a delay tol- 
erance, and a required bandwidth for a call relat- 
ing to delay insensitive high bandwidth services; 
and 

means responsive to the information re- 
ceived from a sender for transmitting bulk infor- 
mation stored in customer premises equipment to 
a recipient at a low traffic period in the network. 

16. The network of claim 10, in which the network 
nodes comprise: 

a low priority queue at each link for han- 
dling bulk information transfers using spare band- 
width without any bandwidth guarantee. 

17. A broadband integrated services digital telecom- 
munications network in accordance with the net- 
work of claim 1 0. 

18. A broadband asynchronous transfer mode tele- 
communications network in accordance with the 
network of claim 10. 

19. A method of allocating bandwidth in a broadband 
packet-switched telecommunications network, 
comprising the steps of: 

classifying calls in the network in accor- 
dance with bandwidth, isochronicity, and delay 
sensitivity; 

queuing information packets for each call 
class into a respective queuing circuit; 

defining a service cycle time period during 
which a predetermined number of information 
packets is removed from each of the queuing cir- 
cuits; and 

removing the predetermined numbers of 
information packets from each of the queuing cir- 
cuits during the cycle time period. 

20. The method of claim 19, further comprising the 
step of: 

admitting additional calls to a queuing cir- 
cuit in response to unused bandwidth in the net- 
work. 

21. The method of claim 19, further comprising the 
step of: 

admitting additional calls to a queuing cir- 
cuit in response to data contained in a call traffic 
table which relates levels of call traffic to required 
bandwidth. 

22. The method of claim 19, further comprising the 
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step of: 

providing a plurality of scheduling 
schemes for completing high-bandwidth delay in- 
sensitive calls. 

23. The method of claim 19, further comprising the 
steps of: 

storing at least one high-bandwidth delay 
insensitive call comprising bulk information in a 
memory in the network; and 10 

delivering that bulk information to a reci- 
pient during a low traffic period in the network 
with a predetermined bandwidth guarantee along 
a path through the network between the mem- 
ory and the recipient. }5 

24. The method of claim 19, further comprising the 
steps of: 

receiving information from a sender relat- 
ing to a transaction size, a delay tolerance, and a 20 
required bandwidth for a high-bandwidth delay 
insensitive call; and 

transmitting bulk information stored in cus- 
tomer premises equipment connected to the net- 
work in response to the information from the sen 
der during a low traffic period in the network. 

25. The method of claim 19, further comprising the 
steps of: 

directing a high-bandwidth delay insensi- 30 
tive call to a low priority queue in the network; 
and 

transmitting the call through the network 
without bandwidth guarantee using spare band- 
width not used by other calls. 35 
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(57) A wide variety of call traffic is effectively 
integrated in a single broadband communi- 
cations network. Calls having widely differing 
bandwidth requirements and sensitivities to de- 
lay are handled by the network with efficient, 
effective, and fair bandwidth allocation and 
transmission scheduling. This is accomplished 
by classifying each call in accordance with 
certain signal characteristics, such as required 
bandwidth and sensitivity to delay. Each call 
class is directed to a separate queuing circuit 
Some calls in certain classes, such as those 
associated with high-bandwidth constant bit 
rate services, are each directed to their own 
individual queuing circuits. Other calls within a 
class are statistically multiplexed into a single 
queuing circuit for that class. A multiplexing 
circuit operates in accordance with a dynamic 
time slice scheme which involves defining a 
service cycle time period during which the mul- 
tiplexer withdraws a predetermined number of 
information packets from each of a plurality of 
queuing circuits containing information pack- 
ets and places those predetermined numbers of 
packets onto an output link. The multiplexer 
breaks up the cycle time period into a plurality 
of time slices, each of which determines how 
many information packets are transmitted from 
each queuing circuit during the cycle time 
period. Efficient resource usage and conges- 
tion avoidance are further achieved by using 
one of a number of alternative scheduling 
techniques for delay insensitive traffic. 
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